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Introduction 

The pendulum is swinging back. While many countries have initially opted to give online 
platforms a safe harbor to eschew liability for third-party content, we are now witnessing 
the reverse trend to weaken that protection. In Europe, this includes the creation of 
regulatory regimes specifically dealing with social media platforms and other information 
intermediaries as well as soft law instruments.' This is to a large extent driven by the (felt) 
need to deal with phenomena like “misinformation," which might have—among other 
negative effects—the potential to erode the integrity of elections and undermine the 
very basis of our democracies.^ Those intermediaries seem to be the only actors capable 
of dealing with the scale and the speed of the problem.^ Furthermore, the debate is 
driven by a growing awareness of their (potential) influence on public opinion-making.'' 

Platforms' control of the chokepoints of online speech make their content moderation 
practices especially dangerous for freedom of speech and freedom of information.* 

Speech can be made imperceptible before there can be any debate about the 
content. Overblocking of content is always a possibility, and it can go unnoticed. 

Regulatory attempts like the German Network Enforcement Act (NetzDG), which 
place responsibility on big platforms to restrict speech on states' behalf, are therefore 
criticized even by those who feel the need to act against harmful content.* 

It is, however, not fair to blame policy makers alone for the persistent lack of an 
adequate and balanced approach to intermediary governance. Even in academic 
research, the functions of intermediaries are not yet fully understood, nor are the 
potential effects of the various forms of regulation. 

Against this background, this article will discuss the structural challenges posed by 
online misinformation compared to traditional offline misinformation; the conceptual 
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difficulties of using information intermediaries as a basis for rational governance; 
recent European policy approaches vis-a-vis communication on platforms and their 
shortcomings; and suggestions from a European perspective for a path towards a 
human rights-respecting governance of information intermediaries. 

Misinformation as a Test Case 

Defining misinformation Eollowing the definition of the Oxford English Dictionary 
{OED)f misinformation denotes "wrong or misleading information." Disinformation 
is also wrong information but unlike misinformation, it is a known falsehood, whose 
active diffusion is intentional. The OED defines disinformation as "the dissemination of 
deliberately false information" and refers specifically to wrong information supplied by 
governments. The term "fake news" is rarely used in academic research anymore since 
it is imprecise and since the reference to "news" can be understood to cover only false 
information in the shape of traditional media reporting. 

Of course, when we speak about misinformation, we have to bear in mind that reality 
is a mediated construction.® Apart from verifiable scientific facts, most of what we 
think of as true is (only) discursively constructed. Our understanding of social reality 
depends to a large extent on dominant discourses and not exclusively on "hard facts."® 
In other words, there is no single "truth," considering that different people see the 
world in different ways. This fluid and context-dependent state of truth puts us into a 
quandary in the context of online misinformation. 

There is indeed a risk in constructing a universe where any attempt to objectively 
define truth is destined to fail and where social reality is formed by hegemonic 
discourses and power structures.'® Nevertheless, we should not lose sight of the value 
of evidence and facts, even when we are discussing nonscientific social reality. We 
cannot allow truth to be reconstructed on dubious and potentially harmful grounds, 
as attempted by the current US president and other "post-truth" politicians, who 
spin misleading narratives to shore up voter support. When we talk about truth and 
misinformation, our baseline should therefore be, to the extent possible and depending 
on the nature of the statement in question, a correspondence with fact-based reality." 

This article uses misinformation on social media platforms as a test case, but the 
arguments developed should inform the broader debate about creating an adequate 
governance framework for information intermediaries. 
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What makes online misinformation different? Misinformation is by no means a new 
phenomenon. Long before the digital era, tabloids and other media formats spread 
falsehoods, construed as propaganda, gossip, or conspiracy theories. Still, the ubiquity 
of the internet has enabled countless new forms of expression that were unavailable 
before. This transformation has fundamentally altered the ways in which information 
is produced and received. Statements of individual speakers can now be amplified to 
reach millions of users across the globe. 

Alongside numerous opportunities, this development has also spurred the spreading of 
harmful content. Misinformation is particularly virulent. Conspiracy theories and false 
allegations spread around like-minded groups on social media and poison the digital 
environment.^^ In addition, targeted online disinformation campaigns by bad actors 
sow mistrust and increase polarization in society.^^ Such manipulation of the public 
opinion has the potential for destabilizing democratic processes.^^ 

The challenges posed by misinformation are exacerbated by the specific characteristics 
of online speech. The first aspect is acceleration. While some content on a social media 
platform might never be noticed by anyone apart from its author, other content can 
go viral in no time. Therefore, governance mechanisms need to work swiftly, since it 
is difficult to locate and deal with misinformation after it has been widely distributed 
and copied.^^ 

Volume is another obvious factor. The sheer quantity of information has become a 
structural challenge.^^ This means that proposals to have national courts—or any private 
adjudicatory body, such as Facebook's new oversight board^^—adjudicate all content- 
related conflicts among users or between user and platform are simply not feasible.^^ 

Additionally, it can be difficult to find out the real identity of speakers online, which 
is necessary to file a claim and, at times, even necessary to check the veracity of a 
statement. Even though some platforms have a clear name policy, anonymity is still 
common online and a central characteristic of internet communication. The exact 
source of online misinformation is also often unclear, so attribution is generally fuzzy.^^ 


The attribution problem is accompanied by weak social control. The operability 
of legal concepts like privacy and its protection depends largely on internalization 
of the relevant norms by the individual. Social norms and social control—not law 
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enforcement—are essential. Those mechanisms are distorted online, especially when 
the speakers have not met each other in “real life." Research indicates that when people 
communicate anonymously, they are more uninhibited—and ultimately more hurtful 
and dangerous.^® 

Furthermore, online platforms often allow users or even the general public to observe 
communication among groups or between individuals. This has enabled the business 
models of rating platforms, but it also creates challenges: observers often do not 
know the context or other crucial information that is necessary to understand the 
speakers' motivations. Many of the problems with online communication stem from 
the fact that the talk at the “regulars' tables" is now visible to everyone, with all its 
exaggerations, polemics, and stereotypes.^^ 

While people initially worried about the internet being a legal vacuum, it has become 
the opposite. Jurisdictional uncertainties are a major challenge, which can hinder 
effective law enforcement online.^^ For instance, content that is criminal in Germany 
can be safely hosted on servers in the United States, where such material is protected 
by the First Amendment.^^ 

It is now a popular saying that the internet never forgets. That is true in the sense that 
there is not yet a way to ensure that a piece of information is deleted from all servers, 
wherever they are located.^'* The so-called right to be forgotten only provides a data 
subject with a claim against a certain controller.^* While it can help make information 
about the subject harder to find in searches, it would be a mistake to think that the 
information can really be expunged.^* 

In sum, these factors further exacerbate the problems posed by misinformation.^^ The 
actors who can address these challenges in the most efficient way are the internet 
intermediaries, whose technological capacities to restrain harmful content are in many 
ways superior to those of states. This is certainly one reason why several European 
governments have introduced regulation of intermediaries targeting misinformation, 
and many others are considering doing so. But before we turn to intermediaries, it seems 
worthwhile to look at the role of the traditional media in the context of misinformation. 

The role of the media Traditional journalistic media still plays a crucial role in informing 
the public and tackling misinformation.^® Research has established that journalistic 
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media—even though it is itself changing and blurring traditional boundaries—still 
fulfills a specific role for the self-observation of societies. Benkler, Paris, and Roberts have 
demonstrated that the role of the media in the US elections of 2016 was significantly 
greater than individual attempts at misinformation.^'^ Ideally, the news industry can 
mitigate the effects of misinformation by providing an antidote to fake stories and 
trolling. Strong professional journalism can correct falsehoods and build public trust, 
although this is becoming increasingly difficult in today's polarized societies.^® 

Given this urgent need for high-quality journalism, the current state of the news 
media is worrisome. Traditional media formats face overwhelming competition in the 
advertisement market from nonjournalistic online players, who have nearly dried out 
their revenue streams. Depleted newsrooms and the dwindling of local newspapers 
and TV stations are the consequence.^' To survive in the contest for peoples' attention, 
traditional media actors are increasingly producing sensationalist and click-bait 
content, which in turn undermines trust in the news media.^^ 

In addition, the constraints of time-consuming professional reporting collide with 
the speed of online misinformation. The window of opportunity for dealing with 
misinformation, i.e., to correct falsehoods or debunk rumors before significant social 
effects can occur, is closing ever more rapidly. Consider the difference: In the midst 
of the 1800 US presidential election campaigns of Thomas Jefferson and John Adams, 
the rumor spread that Jefferson had suddenly died. News reports that clarified the 
situation traveled slowly then, but so did the rumors. Today, the pace has picked up 
dramatically. Unlike in the times of Adams and Jefferson, online misinformation can 
spread virally in a matter of hours. By the time professional journalists have picked up 
the issue, it is often too late, and the damage is done. 

Understanding Internet Intermediaries 

In order to address misinformation in a meaningful way and to design adequate 
regulatory responses, an understanding of internet intermediaries is crucial. They have 
become extraordinarily powerful institutions in the networked digital sphere. Performing 
a crucial function as the internet's "middlemen," they facilitate online interaction and 
dissemination of information between different parties by offering a variety of services.^^ 

Various activities and business models fall under the broad category of internet 
intermediaries. Most of them carry out several functions in parallel. Notably, 
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intermediaries may moderate and rank content, using algorithms designed to increase 
profits. This allows them to influence users' access to information online in ways 
comparable to those of traditional media.^'* While their importance is obvious, there 
are structural difficulties in conceptualizing intermediaries for governance purposes. 
Their ambiguous nafure challenges fradifional governance techniques like defining 
a type of service and aftaching righfs and obligafions fo the so-defined entities. This 
also leaves room for polifical "fighfs about narratives": for example, while lobbyists for 
publishing houses fend fo frame intermediaries as distribution platforms for fheir own 
journalisfic contenf, fhe platform companies fhemselves tend to portray their services 
as technical mere tools for users (or at least want politicians to see them that way). This 
section considers these conceptual challenges for regulators. 

No necessary link between services and communicative practices Even with traditional 
media, there is no necessary link between the type of media and fhe communicative 
practices of fhe audience. You can be educated by comedy shows and you can be 
entertained by news shows. When it comes to intermediaries, the link between their 
intended use and their actual use is further attenuated. Take search engines as an 
example. You can use search tools to find a website whose URL you cannot remember, 
but you can also "ask" a search engine a question like, "What has the president done 
today?" You may even use it as a spell-checker and for other purposes that the search 
engine provider might not have foreseen. This is an observafion wifh relevance not 
limited to media studies, given that the ability of intermediaries to influence public 
opinion depends on and varies according fo fhose communicative practices. It is 
therefore crucial thaf policy makers assess the risks stemming from plafforms' various 
affordances when they design regulation. 

Hybrid nature of services Another obstacle in designing adequate regulatory solutions is 
that many information intermediaries are hybrids. For example, one aspect of Facebook's 
activity is merely providing a platform for hosfing and sharing content that users 
upload. Simultaneously, another aspect of its activity—the newsfeed—can be seen as an 
information service that at least partly fulfills funcfions comparable to traditional news 
media. It has even become an important means of distribufion for media confenf. This 
complicates the application of traditional concepts of regulation, since one might have to 
simultaneously treat the different subservices differently: whereas the curation of contenf 
could be concepfualized as a form of editorial confrol under media law, for insfance, fhis 
approach would be poinfless when it comes to regulating other, content-neutral functions. 
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Differentiated functions for public communication The recent Reuters Digital News 
Survey reveals the importance of Instagram for news consumption in Germany, to 
take an example. Instagram is the social medium most frequently used to get access to 
news by online users in the age group of 18-24.^^ If one looks at older target groups, 
however, traditional television is still by far the most important source of news, and 
social media plays a secondary role.^^ Considering this diversity of usage patterns, 
which is unlikely to change in the foreseeable future, it is difficult to develop a 
generalized understanding of the role of intermediaries and to develop regulatory 
concepts. By way of example, emphasizing intermediaries' role in informing the public 
and obligating them to prioritize trusted news sources may have an impact with 
respect to younger users, but would be of limited use for older user demographics. 

Algorithmic sorting and ranking are not fully understood A further challenge 
arises from the fact that many functions of intermediaries are based on algorithmic 
calculations, which sort or select information. These algorithms have various effects, 
such as content amplification. The current discussion about errors related to decision 
making by and in connection with algorithmic decision systems shows the range 
of problems. We still lack definitive knowledge about how errors or biases in the 
training data for machine learning systems impact the algorithms themselves, and, 
subsequently, human decision making. 

In sum, policy makers and scholars are faced with a twofold challenge: On the one 
hand, online misinformation presents substantial problems, which I have discussed 
in the previous section. On the other hand, any attempt to address these challenges 
through platform regulation is additionally burdened with the structural difficulties in 
conceptualizing internet intermediaries. 

European Approaches to the Governance of Internet Intermediaries 

In this section, I will discuss recent regulatory approaches by European policy 
makers to tackle online misinformation on platforms. This analysis focuses on the 
governance of platforms, that is, the regulation of platforms by states, as opposed to 
the governance by platforms, that is, platforms applying their own standards to the 
communication of their users. Of course, these two components are intertwined, 
and governance of intermediaries might lead to new forms of governance by 
intermediaries. 
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Reasons for Safe Harbor Rules 

The initial approach to platform regulation by many states was to shield internet 
intermediaries from liability—an approach that may now seem counterintuitive. Given 
intermediaries' importance for online communication, policy makers recognized 
early on that holding intermediaries liable for illegal activities by third parties might 
significantly inhibit the free flow of information. They feared that platforms might 
overblock content in order to avoid liability.^^ In response, key jurisdictions—the 
United States and the European Union—adopted so-called safe harbor rules that have 
become a cornerstone of today's platform economy. 

In the European Union, the safe harbors are enshrined in the e-Commerce Directive,^^ 
which shields intermediaries from liability for third-party content. The motivation 
behind the safe harbor clause in the e-Commerce Directive was not so much to 
protect freedom of speech as it was to allow the European IT sector to grow without 
having to fear incalculable liability risks. Platforms such as Facebook or YouTube are 
granted immunity under Article 14 of the e-Commerce Directive if they meet specific 
conditions. To benefit from the safe harbor protection, they need to expeditiously 
remove or block access to unlawful content once they become aware of it. Article 14 
of the e-Commerce Directive has led to the development of notice and takedown 
procedures, but it does not regulate those procedures in detail. 

Compared to its US equivalent. Section 230 of the Communications Decency Act 
(CDA), the immunity afforded by the e-Commerce Directive is more limited, since the 
former shields intermediaries from liability even if they have positive knowledge of 
unlawful content on their platforms. Unlike Section 230 of the CDA, the e-Commerce 
Directive also only insulates platforms from monetary liability; it does not affect court 
injunctions to take down content. Many countries have adopted similar regimes, 
although they differ in their scope of application and in how much immunity they 
grant to information intermediaries. 

Towards Intermediary Responsibility? 

In recent years, regulators in the European Union have called the liability protection 
afforded by the e-Commerce Directive into question.^® Given the proliferation of 
misinformation and hate speech online, European policy makers have increasingly 
pressured intermediaries to assist them in combating harmful speech.^^ They have also 
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started to reduce the immunity granted to platforms in specific sectors, for instance by 
adopting regulation in the copyright sector. 

Intermediaries are tempting targets for government regulation because they control 
the important chokepoints of online information. Moreover, their capacity to restrain 
illegal activities on their services is in many ways superior to that of states. They can 
block access to certain content or eliminate misconduct by suspending the accounts 
of wrongdoers, regardless of their anonymity.'*^ Unlike most states, big platforms also 
have powerful content-recognition technologies at their disposal to identify infringing 
content before it spreads around the web.'*^ 

Platform regulation therefore allows governments to, at least indirectly, set the rules 
for online speech. This raises hard questions as to how much responsibility should be 
placed on platforms to implement speech control on behalf of states. On the one hand, 
delegating the enforcement of rules set by states to intermediaries is seen as the most 
efficient, if not only, way of maintaining control over online speech. On the other 
hand, enlisting private entities as "proxy censors" creates new problems, especially 
from a human-rights perspective.'*'* 

New European Approaches to Tackle Misinformation 

Unfortunately, there is no easy fix to misinformation online. Calls for government 
regulation are understandable, but they can create new problems. As 1 show in this 
section, any attempt to curtail misinformation carries risks of unintended collateral 
effects, especially regarding the right to freedom of expression. 


In the following, 1 discuss two recent regulatory approaches for addressing 
misinformation, which represent two broader trends in European intermediary 
regulation: First, 1 will briefly examine the EU Code of Practice against Disinformation 
as an example of using "soft law" instruments to achieve public-policy objectives. 
Second, 1 will focus on the German NetzDG as an example of a novel law specifically 
tailored for intermediaries. 


“Soft law” approach: The EU Code of Practice against Disinformation Faced with 
growing concerns about the impact of online misinformation on European election 
campaigns and democracy in general,'** the EU Commission negotiated a voluntary 
Code of Practice against Disinformation with large platform companies, including 
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Google, Facebook, and Twitter, and representatives from the advertising industry in 
September 2018.'“’ The signatories agreed to implement a wide range of commitments 
to fight disinformation that is “created, presented and disseminated for economic gain 
or to intentionally deceive the public" and that “may cause public harm." Depending 
on the signatories' various modes of operation, the commitments include measures 
to increase transparency in political advertising, efforts to reduce the revenues of 
commercial distributors of misinformation, and the suspension of fake accounts. 

After first reports by the signatories were submitted in early 2019 to document their 
implementation of the Code, the EU Commission welcomed the progresses rnade.'*^ 

Yet it urged the platform companies to “develop a more systematic approach to 
enable a proper and regular monitoring and assessment, on the basis of appropriate 
performance data.'"*® The commission also announced a comprehensive assessment 
of the code's initial twelve-month period, stating that, “should the results prove 
unsatisfactory, the Commission may propose further actions, including of a regulatory 
nature."'*'’ 

The Code of Practice was no small feat. The commission successfully encouraged 
stakeholders from the private sector to agree, for the first time and on a voluntary 
basis, to reduce the spread of online disinformation.*® At the same time, human-rights 
activists have voiced concerns over this “soft law" approach, arguing that it pressures 
platforms into removing content without meaningful safeguards such as an appeal 
system or review of the takedown decisions made under the Code.** 

New laws for intermediaries: The NetzDG as an example Germany's NetzDG, short 
for Network Enforcement Act, is an instructive example of the second regulatory 
approach—specific laws governing information intermediaries. Even though the act 
does not address misinformation directly, it was designed in part to solve the problem 
of misinformation online. 

Genesis of the act After an influx of refugees in 2015 created a massive backlash 
from right-wing populists, the German government was concerned that hate speech 
and misinformation could influence the 2017 Bundestag election campaign.*^ One 
instructive example of harmful misinformation that received much attention in 
Germany involved a selfie that a Syrian refugee took with Angela Merkel. Right-wing 
groups used the photo to falsely assert that the refugee was involved in terrorist 
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activities. That fake news went viral. Some of the posts that used the word 'Terrorist" 
relating to the refugee were removed by social media platforms as harmful content. 
These takedowns were not only aimed at right-wing trolls, however. Equally 
affected were users who referenced the fake news in order to critically reflect on 
hate speech. 

Germany's Ministry of Justice initially encouraged big platforms to voluntarily improve 
their complaints mechanisms. After reviewing the measures taken, the German 
government was not satisfied with the platforms' effort at self-regulation. According to 
the Ministry of Justice, Facebook in particular reacted too slowly to complaints about 
content; Twitter likewise generally had low response rates. 

Against this background, the government hurriedly introduced a draft bill to impose 
binding rules on platforms. Although experts roundly criticized its approach, the 
ruling coalition pushed the NetzDG through parliament.It came into force on 
October 1, 2017, and has been fully applicable since January 1, 2018.^^ 

The NetzDG's regulatory concept The NetzDG covers social network providers; to 
exempt start-ups and small and mid-size enterprises (SMEs), the act imposes some 
obligations only on platforms with at least two million users. The main provision of 
the NetzDG stipulates that large providers with more than two million users must 
maintain an effective and transparent procedure for handling complaints about 
unlawful content. They have to remove or block access to content that appears to be 
"manifestly unlawful" within twenty-four hours after a complaint has been filed. 

Other unlawful content has to be taken down within seven days. This review period 
may exceed seven days in case more time is required to reduce "overblocking," or when 
providers refer the decision to an independent co-regulatory body.^^ Social network 
providers that receive more than one hundred complaints per year also have to 
produce transparency reports every six months. 


The act does not include new definitions of hate speech or misinformation. Instead, it 
refers to existing definitions under the German criminal code. Content is considered 
illegal under the NetzDG if it falls within the scope of an exhaustive list of speech- 
related criminal offenses. Several of these offenses are aimed at protecting public safety 
(such as incitement to hatred), while others are aimed at safeguarding individual 
rights (such as slander and defamation).While earlier drafts included the obligation 
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to properly handle each individual case, the final act only requires a functioning 
complaints system.*® The Federal Office of Justice, an administrative body directly 
subordinated to the Ministry of Justice, oversees compliance with the NetzDG. If 
providers systemically fail in their obligations under the NetzDG, they face a fine of up 
to 50 million euros. So far, no fines have been imposed. 

Basic critique On the whole, the NetzDG is an example of good intentions falling 
short. Its vague wording has been sharply criticized; for instance, there is uncertainty 
as to what constitutes "manifestly unlawful" content.*® 

There is also good reason to argue that the NetzDG conflicts with the e-Commerce 
Directive.*® Proponents of the act maintain that there is no contradiction between 
the instruments, since the NetzDG merely enforces existing obligations to remove 
unlawful content upon notification.*' However, as previously mentioned. Article 14 
of the e-Commerce Directive does not impose tight time frames, whereas the NetzDG 
does. Under the directive, platforms are only required to act expeditiously. The time 
frames imposed by the NetzDG might therefore counteract the e-Commerce Directive's 
objective to harmonize cross-border services,*^ since they lead to divergent procedures 
to establish intermediary liability across the European Union.** 

In addition, the ramped-up efforts of big platforms to tackle harmful content have 
caused users with extreme views to migrate to smaller platforms that lack the resources 
to moderate content that major players such as Facebook or YouTube have.*'' In effect, 
misinformation still circulates around the web, but seems partly to have moved to 
smaller platforms that are not subject to the NetzDG. 

Another point of criticism is that NetzDG enforcement is not detached from 
politics. As mentioned already, the Federal Office of Justice supervises the NetzDG's 
implementation and directly reports to the minister of justice. That institutional setup 
is especially notable in Germany, where state-controlled media evokes memories of 
the Nazi dictatorship and the German Democratic Republic. Therefore, the Federal 
Constitutional Court regards the independence of media regulation from state 
interference as an eminently important principle.** 

These are only the broad lines of criticism, which explain why many scholars and 
activists maintain that the law was poorly crafted. On a more general level, the 
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NetzDG's many weaknesses indicate that targeting intermediaries to control speech 
may not be the silver bullet after all. 

Debate on overblocking and recent developments The NetzDG has initiated a heated 
debate as to whether the law encourages overblocking. Critics argue that the NetzDG 
creates a strong incentive to systematically take content down rather than leave it 
up.®® There is indeed a good case to be made that this regulatory approach leads to the 
excessive removal of content, given that the law forces platforms to make decisions 
about the lawfulness of content within tight time frames, under threat of substantial 
fines. 

This argument is lent further weight by the fact that the NetzDG obligates intermediaries 
to make highly context-dependent decisions at scale. To provide some perspective, 
YouTube reportedly received more than 160,000 NetzDG-related complaints between 
July and December 2018 (the number of pieces of content flagged under the company's 
private content policies is likely much higher).®^ Moreover, intermediaries can only 
assess the information available on the platform in order to understand the context. 
They lack the adversarial evidentiary process that courts have at their disposal. 

There is still insufficient data to empirically substantiate the concerns regarding 
overblocking, however. As of now, the extent of overblocking—if any—and a potential 
chilling effect is hard to measure. Although big platforms have released three rounds 
of biannual NetzDG transparency reports so far, the reported numbers are inconclusive 
regarding overblocking, since they only reveal the number of complaints and the 
actions taken. In addition, there appears to be a significant divergence between the 
number of NetzDG complaints received by Facebook, Twitter, and YouTube. While 
Twitter®® and YouTube®'^ reported 264,818 and 214,827 complaints, respectively, from 
January to June 2018, Facebook only counted 886 complaints during the same period^® 
(the number dropped even further to just 500 complaints for the period from July to 
December 2018^'). This is mostly due to the fact that platforms appear to prioritize 
their own private content policies over the NetzDG to varying degrees.Facebook 
especially makes it more difficult for users to file a NetzDG complaint than a complaint 
under its private framework.^® Since content removed under these policies does not fall 
within the scope of the NetzDG transparency obligations, the effect of the NetzDG is 
not really visible.^'* 
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To overcome the lack of available empirical data/* platforms need to open their data 
troves to external researchers to facilitate a more informed discussion about the 
actual effects of harmful content and the impact of content regulation. What has 
been described as Facebook's recent "Glasnost moment"^* is a welcome development 
in this regard.^^ Meanwhile, the NetzDG has been imitated elsewhere, including in 
nondemocratic countries. Most notably, Russia passed anti-fake news legislation 
modeled on the NetzDG, with explicit reference to the German law in the travaux 
preparatoiresJ^ 

A European Perspective on Human Rights and Platform Regulation 

As discussed above, the recent regulatory attempts to deal with misinformation in 
Europe raise grave concerns given their broad scope, their restriction of public and 
individual communications, and their lack of procedural safeguards. While such cases 
of (enforced) private censorship are not commonly framed as a human-rights issue in 
the United States, these risks have human-rights implications from the perspective of 
European fundamental-rights doctrine. 

The right to freedom of expression is protected in Europe under Article 10^® of the 
European Convention on Human Rights (ECHR).®° In addition to a focus on state 
interferences, similar to the First Amendment state-action doctrine, it also imposes 
positive obligations on states to protect citizens' freedom of expression vis-a-vis private 
entities.®^ 

General threats to freedom of speech Against this normative background, the 
NetzDG in particular does not strike a good balance between its objective of 
countering harmful content and protecting online expression. Considering that the 
act is likely to make platforms remove lawful content, there is a good case to be made 
that it infringes on freedom of speech. Moreover, besides curtailing lawful speech, 
overblocking likely has an overall chilling effect on users' (future) exercise of their 
freedom of expression.®^ 

Doctrinal difficulties There remain many open questions regarding the level of 
protection afforded by ECHR Article 10 in the context of misinformation. In particular, 
the private nature of intermediaries and the fact that regulation such as the NetzDG 
does not directly target users complicate the analysis, given that under classical liberal 
doctrine, only state actors can interfere with fundamental rights.®* 
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This complexity is further increased by the multitude of actors whose communication 
freedoms are potentially affected: (1) the “victim" smeared by misinformation on 
the platform, who may also be the complainant; (2) the provider of the social media 
platform; (3) the creator of illegal content that is taken down; (4) the author of lawful 
content that is (wrongly) taken down; (5) the intended recipients of the removed 
content.®'* 


Among these actors, the fundamental-rights protection of intermediaries is 
particularly unclear. It remains an open question whether regulatory efforts to address 
misinformation might also infringe on platform companies' own right to freedom 
of speech (besides the right to do business).®® Whereas they clearly enjoy protection 
for their own statements, it is heavily debated whether the provision of a platform as 
such and of its specific functions are protected as well. This is especially relevant to 
the curation of social media content, such as Facebook's news feed, since the editorial 
decisions taken in this context might also constitute protected speech.®® Further, 
intermediaries enable or at least facilitate the communication of others and may 
indirectly fall within the scope of free-speech guarantees for this reason. An adequate 
fundamental-rights analysis would have to differentiate between the various functions 
performed by intermediaries described above. 


Potential justification A last aspect 1 would like to stress in the context of the NetzDG 
is how potential interferences with fundamental rights could be justified under 
ECHR Article 10. Under this framework, interferences can be justified under certain 
conditions. Their legality is contingent on a proportionality test, which takes into 
account whether the legislation "is necessary in a democratic society." In most cases, 
the condition is met if coercion by the state is necessary to prevent harm to others.®^ 
This harm principle, tracing back to John Stuart Mill, could justify content regulation 
if it prevents users from being subjected to harmful speech. 


There is reason to be skeptical about the existence of such a justification regarding the 
NetzDG. It is noteworthy that the official explanatory memorandum for the NetzDG 
does not even directly refer to the harm principle. It instead refers to the necessity to 
maintain a culture of political debate. This is understandable in light of the far-right 
populist movements at the time of the NetzDG's inception. Nevertheless, a desire to 
protect the civility of political debate is insufficient for limiting fundamental rights; it 
instead turns the NetzDG into an instrument of a purely moral nature. At least as long 
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as there are no grave structural risks for a free and open political debate, it is not the 
role of the state to govern how public opinion is formed in society.®* 

Toward a Human Rights-Respecting Approach 

Going forward, it is crucial that we develop regulatory approaches to misinformation 
that respect freedom of speech. 

Council of Europe’s Standards on the Roles and Responsibilities of Intermediaries as a 
starting point*® Apart from the work of the UN Special Rapporteur on the promotion 
and protection of the right to freedom of opinion and expression,®® the Council of 
Europe's Standards on the Roles and Responsibilities of Intermediaries®' is the most 
comprehensive attempt to create a human rights-oriented framework in the European 
context. 

The Council of Europe (COE) acknowledged the possibilities for communication and 
information access opened by information intermediaries but also highlighted their 
role in spreading potentially harmful speech. The COE recommended a functional 
approach that takes the above-mentioned hybrid nature of many intermediary services 
into account. 

Under the COE framework, it is primarily the obligation of states to make sure 
that laws, regulations, and policies applicable to internet intermediaries effectively 
safeguard the human rights and fundamental freedoms of users. At the same time 
and in line with the UN Guiding Principles on Business and Human Rights,®^ internet 
intermediaries have the responsibility to respect the internationally recognized 
human rights of their users and of third parties affected by their activities. States and 
intermediaries therefore need to cooperate in safeguarding freedom of expression. 

As for regulation by the states, the COE reaffirms that any limitation of human rights 
requires a clear legal basis, and that the process of enacting legislation applicable to 
internet intermediaries should be transparent and inclusive. This poses challenges to 
systems of coregulation, which—as the EU Code of Practice against Disinformation 
instructively shows—are often predicated on nonbinding commitments by private 
companies. Shifting the responsibility to the companies cannot release the state from 
its fundamental-rights obligation, however; at least in the case of coregulation, an 
interference with freedom of expression by intermediaries may be attributed to the state. 
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In order to ensure that content regulation meets the conditions foreseen in ECHR 
Article 10, state authorities should therefore carefully evaluate the prospective 
(unintended) impact on freedom of expression and should opt for the least intrusive 
means. Such a human-rights impact assessment would force regulators to preemptively 
address adverse consequences. State authorities should also ensure that effective redress 
mechanisms are made available and adhere to applicable procedural safeguards. 

Differentiated approach to take context into account As the example of the NetzDG 
shows, there is reason to worry that content regulation disproportionally curtails 
protected speech, since it forces intermediaries to make highly context-sensitive 
decisions within tight time frames and based on insufficient available information. 

The heavy reliance on (semi-) automated flagging systems further exacerbates the 
problem. Despite all the progress in the field of automated content recognition and 
intelligent speech processing, these systems do not (yet) have the cognitive capabilities 
of human reviewers. They are still error-prone and cannot reliably detect irony or other 
double meanings.'’^ 


A human rights-oriented approach to intermediary governance therefore needs to take 
both this state of the art of automated content moderation and the complex nature of 
misinformation into account.®'* Of course, some content should still be taken down as 
quickly as possible, despite fundamental-rights concerns. These should be limited to 
severe cases, such as misinformation that may cause an imminent risk of grave harm, 
for instance where online incitement based on false allegations may spill over into the 
offline world and mobilize violent mobs against vulnerable groups. 

In all other cases of less grave misconduct, it is necessary to establish a procedure 
that allows for a sufficient consideration of individual pieces of content, including 
by human content moderators. Context is obviously crucial here. The same material 
may either be lawful or unlawful depending on the respective circumstances. For 
instance, a tweet that violates the law may be repeated elsewhere as satire or as a 
critical discussion. The latter can only be recognized as a lawful expression after close 
inspection of the speaker's intention.®* 


Moreover, we need to differentiate between content decisions that the intermediary 
is able to make based on the information available on the platform alone and other 
content decisions that require further input. The latter could require cooperation with 
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external fact-checkers or a procedure that allows the parties involved to be heard. For 
instance, there is evidence that the platforms have experienced more difficulty in 
reacting to alleged acts of insult, slander, and defamation than responding to other 
criminal offences under the NetzDG, such as incitement to hatred. This might be 
because the former category of offences is more context sensitive, and deciding related 
disputes is often only possible after hearing both sides. Furthermore, there is a thin 
line between those acts and offensive but legal speech. 

Additional measures Considering the complexity of the challenges posed by 
misinformation, an adequate governance approach will require a wide range of 
complementary measures. In the following, I outline some of them (naturally, all 
these proposals have costs and benefits that require further analysis to examine their 
advantages and potential shortcomings):^^ 

• With regards to misinformation, a system of fact-checking and labeling 
of questionable content might be part of the solution. We also need more 
cooperation with platforms to be able to research the effects of fact-checking 
efforts. This could be done in a much more granular way than it is done now. 

• There should be user-friendly tools to report content that users think is 
misleading. This especially pertains to digital election campaigning. 

• Further, we need systemic support for people who fall victim to misinformation 
or hate speech. In particular, journalists, who are often massively harassed online, 
need better protection. 

• Platforms should also be encouraged to design and implement instruments of 
dispute resolution, so that conflicts can be solved between the parties themselves. 

• Users need to be able to distinguish between quality online journalism and 
material coming from dubious sources. This could involve online tools developed 
by self-regulatory bodies that assist users in that regard. 

• Platforms should also be more transparent about how they curate content, so 
users have a better understanding of why they are exposed to certain information 
and can appraise information more critically. 

• Another component of a comprehensive approach is to enhance knowledge about 
counterspeech, for instance by teaching techniques on how bystanders can be 
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mobilized to de-escalate in an online conflict. Extensive research about various 
approaches and their effects already exists.^^ Put into practice, it could help to 
limit dangerous speech. 

• Traditional law enforcement needs to be brought up to speed in the digital 
era, so perpetrators and victims alike do not feel that speech-related crimes go 
unpunished online. Content regulation may complement criminal prosecution, 
but it must not replace it. 

• At the same time, intermediaries should minimize financial incentives for those 
who seek to profit from misinformation. 

• Finally, fixing the problem of misinformation and hate speech goes hand in 
hand with strengthening civil society and the media. Given the opaque business 
models of many platforms, we need a high level of scrutiny from journalists and 
civil society organizations. A healthy information ecosystem requires professional 
journalism with sufficient budgets and civil society actors committed to the 
public interest. 

Conclusion 

Unfortunately, discussions about an appropriate regulatory response to misinformation 
often center on issues such as politics or the overt influence of big (US) tech 
companies, which are only tangentially related to the actual problem. This is 
unfortunate, since what is really at stake is the unmanipulated formation of public 
opinion and the freedom of online speech. This does not mean that curbing 
companies' unchecked power and challenging ''post-truth" politicians are not 
legitimate concerns. In order to rationally dissect the issue of misinformation, however, 
we need a more nuanced discussion that differentiates between different types of 
content (including the basis of their context dependency), respects the proportionality 
principle, and seeks to develop a clear and transparent separation of the responsibility 
of states and of platform providers. 
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